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A METHOD AND COMPUTER-IMPLEMENTED PROCEDURE FOR CREATING 
ELECTRONIC, MULTIMEDIA REPORTS 



Field Of The Invention 

The present invention relates generally to an image reporting method 
ai^d system and more particularly to a method and computer-implemented 
5 procedure for creating electronic, multimedia reports based on a new reportmg 
paradigm. 



Background OF The Invention 

Image reporting as currently practiced suffers from a lack of 
standardization, consistency, accountability, and efficiency. A root cause of 
10 these problems is the manner in which reports are generated, beginning with the 
lack of a standardized report format, particularly in the medical field of 
radiology. 

Radiologists generally review images of a body structure and dictate 
narrative descriptions of their image findings followed by summary statements- 
15 Transcriptionists then transcribe the dictated statements and either print 
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applicable reports or enter such information into a computerized radiology 
information system (RIS). As a result, the content and format of radiology 
reports often vary greatly depending on the differing preferences and styles of 
individual radiologisLs. This inconsistency among the radiologists' reporting 
5 styles often hinders the correlation of the reported findings with the actual 

images by the recipients of the reports. Variability in the reporting styles also 
impedes on-going monitoring of specific findings from different examinations 
on the same patient^ a task that is critical for patient care and time-consuming 
for radiologists. Further, traditional radiology reporting practices do not support 

10 data mining, a powerful tool which is useful in clinical trials, epidemiology 
studies, and outcomes analyses. 

In addition, conventional reporting practices often provide no 
mechanism to allow the radiologist to account for the effective conmiunication 
of critical report information to the recipient. Frequently, radiologists 

15 mistakenly assume that when a report is approved and sent to a referring 
medical professional, their responsibility ends. To the contrary, however, 
radiologists are often held accountable for ensuring that proper action is taken 
on significant findings and are held liable for malpractice when proper action is 
not taken. 

20 Clinicians are the typical end-users of reports from radiologists. A 

major complaint of such clinicians against radiologists and their reponing 
practices involves point of service. This problem is illustrated by the following 
scenario: a patient receives emergency room x-rays for an injury during the 
night; a radiologist interprets the x-ray images the next morning; and, following 

15 transcription, a report is fmally delivered to the emergency room physician, but 
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typically only after the patient has been treated and released. Clinicians arc now 
demanding (hat radiologists issue reports immediately after an imaging study 
has been performed. 

Hence, there is a pressing need to provide a reporting system which 
5 offers a standardized report format, enables consistency among reports, 
accounts for effective information flow, provides for quick turnaround of 
information to the end-user, and supports data mining for public health 
statistics. In addition, these needs extend beyond the field of radiology, and 
include other medical fields such as pathology, cardiology, dermatology, as well 
10 as other image analysis fields such as satellite imagery and photography. 



Summary oF the Invention 

The present invention relates to a new reporting method and system 
for reporting the findings of an expert's analysis of image data and, more 
specifically, to a computer system and computer-implemented method for 

15 reporting an expert's findings relative to an analysis of image data. The method 
and system are based on a new reporting paradigm. The paradigm forms the 
basis of a radiology practice management system that can efficiently and 
systematically generate radiology reports, facilitate data entry into searchable 
databases, support clinical trials and outcomes analyses, and expedite hospital 

20 bilhng and collections. One fundamental aspect of this paradigm is that an 
expert, e.g. a radiologist, identifies a diagnostically significant feature on an 
image and attaches a location: description code^ or in the case of radiology an 
anatomical rpathological code, to the location of that feature in order to create a 
finding, or in the case of radiology a diagnostic finding. The 
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anatomical: pathological code includes the anatomical location followed by a 
pathological description. Optionally, further attributes of that finding, such as 
dimensional measurements (e.g., length, area, and volume), audio descriptions, 
3D rendered snapshots, etc., may be automatically appended to the diagnostic 
5 finding as secondary attributes of the diagnostic finding. All of this information 
is automatically captured in an intuitive workflow scheme transparent to the 
expert, and stored in a database. The expert may continue to identify additional 
diagnostically significant features and create diagnostic findings in any order. 
At the end of the expert's evaluation of the image(s), the system sorts the 

10 diagnostic findings by selected or predetermined categories. In a medical field, 
these predetermined categories may be anatomical categories. The diagnostic 
findings are further prioritized by the severity of the diagnosis in order to alert 
the report recipient, e.g., a clinician. The expert can edit and approve a 
multimedia report, which may be delivered to an Internet server for immediate 

15 access, sent to a database, sent by automated voice, fax or e-mail to the 

clinician, or any combination thereof. The radiologist can sign the report by 
electronic or voice signature. The final report presentation may be further 
customized to satisfy the needs of the clinician. 

The reporting system of the present invention is applicable to several 

20 other image-based fields including pathology, cardiology, dermatology, satellite 
imagery, and photography. 



Brief Description Of The Drawings 
The foregoing summary and the following detailed description of the 
preferred embodiments of the present invention will be best understood when 
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read in conjunction with the appended drawings, in which: 

Figure 1 illustrates a flowchart representing a general method in 
accordance with the present invention for creating an image report; 

Figxire 2 illustrates a block diagram of a computer system used in the 
5 computer-implemented method of the present invention; 

Figure 3 illustrates a flowchart representing the steps of the process for 
creating an image report. 

Figure 4 illustrates a flowchart representing steps of operation of the 
method of the present invention; 
10 Figures 5 A and 5B illustrate the steps of annotating findings; 

Figures 6 illustrates the user-inlerfaceof the present invention in which 
Figure 6A shows a 2D viewer and Figure 6B shows a 3D viewer; and 

Figures 7A-7C illustrate a selected report of the present invention. 



Detailed Descriptiod Of The Inventioa 

15 A method and system are provided for generating and commimicating 

reports containing an expert's analysis of image data as generally depicted in 
Figs.l and 2. In addition, a computer- implemented method and a computer 
system function to create a database of the expert*s findings from which a report 
is generated and from which data mining and other analyses may be conducted. 

20 The database can be a computer searchable database and may be a relational 
computer database. 

The method and system of the present invention are applicable to any 
field which relates to an expert's analysis of images- Li particular, however, the 
method and system of the present invention are well-suited to image analysis 
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found in medical applications. As such, the method and system of the present 
invention arc illustrated in the accompanying figures and description in terms of 
the medical field of radiology. 

The method and system are particularly well -suited to the analysis of 
5 digital images. However, the method and system may also be adapted for use 
with analog images such as conventional x-ray films. For example, the system 
can utilize a digital camera to load a digital representation of an analog image 
into computer memory for further processing. 

The computerized reporting system 10 is designed to interface with 
JO existing information systems such as a Hospital Information System (HIS) 36, a 
Radiology Information System (RIS) 34, and a Picture Archiving and 
Communication System (PACS) 32. The reporting system 10 includes an 
examination image storage 22, a computer console 24, a computer 26, display(s) 
28, and an input device 27. For illustration purposes ttic input device 27 is a 
15 three-button computer mouse, where the left and middle-mouse buttons (LMB, 
MMB> are used, for example, to manipulate image data, and the right-mouse 
button (RMB) is used, for example, to identify a new diagnostically significant 
feature and to start a database recording process. Other known input devices 
including LCD graphics tablets ard touch-screens may be used as well as other 
20 custom devices. For example a intelligent view box and digital camera device 
can be used with conventional x-rays. 

Bidirectional conununication between the reporting system 10 and the 
information systems 32, 34, 36 allows the reporting system 10 to retrieve data 
from the such information systems 32, 34, 36 and to update informadon in these 
25 systems to provide the desired report generated by die reporting system 10. For 



wo 01/11548 PCT/US00/21M3 

example, the reporting system 10 may download image data corresponding to 
radiological examinations of patients from the PACS 32. The PACS 32 stores 
information according to existing standards such as "Digital Imaging and 
Communications in Medicine" (DICOM). The data from the PACS 32 is stored 
5 in the examination image storage 22 where it can be accessed via the computer 
console 24 and computer 26 for display on the display 28. Alternately, the 
reponing system 10 can directly access the PACS images without the n^ed for 
an intermediate storage device, such as image storage 22. Additionally, the 
reporting system 10 may be linked to communication systems such as the 

10 Internet, e-mail systems, fax, telephone, wireless communications systems such 
as pagers and cellphones, and other communication systems. 

Referring now to Figs. 1 and 3 which illustrate the general method and 
detailed process steps of the present invertion, respectively, preparation of a 
report begins with the loading of patient data, including billing, demographics, 

15 and image data, step 100. A file loader from computer 26 searches the 

examination storage 22 for examination data files available for analysis and 
displays the corresponding names of patients in a user-interface at step 300. 
Upon selection of a particular patient by the radiologist, the file loader displays 
all of the associated unread examination files for that patient. The radiologist 

20 selects a particular examination file, and the file loader loads the corresponding 
data into computer memory at step 302. The file loader searches through the 
image data in the selected examination and organizes the images by DICOM 
series (or any additional subdivisions),at step 304, prior to display in 2D, and 
optional 3D, viewers. 

25 The file loader also displays die Current Procedural Terminology (CPT) 
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and [ntemational Classificatioti of Diseases CICD) codes assigned to the selected 
examination and detemiines if they correlate at steps 102 and 306. (CFT codes 
describe the type of radiologic examination, and ICD codes indicate the reasons 
for performing a particular examination ) Proper matching of these codes are 
5 often essential for reimbursement by health care insurers. The file loader 
compares the ICD and CPT codes and displays an alert if the codes arc 
incompatible. The radiologist verifies the codes and enters any necessary 
changes. Correct assignment of these codes at the beginning of an examination 
is effected by the reporting system 10 to intelligently guide the presentation of 

10 diagnostic code menus during the annotation process described below. Prior to 
the review process, an anatomical-location menu and a pathology-description 
menu are initialized using the CPT codes at step 308. Likewise, a series menu is 
initialized to list all of the DICOM series available in the selected examination 
file at step 308. In addition, the file loader retrieves existing "new paradigm" 

15 reports, i.e., those created using the present invention^ from the patient's 

previous examinations and makes them available for review during the current 
study. 

After initialization of the menus, the first available image from the 
sorted images is displayed in a user-interface by a 2D viewer 610 as shown in 

20 Fig. 6A ftnm which the radiologist may begin analysis of the first image^ at 
steps 104 and 310. Alternately, the radiologist is free to select a different 
DICOM series for evaluation from the series menu. For example, a CT or MRI 
examination often consists of multiple series, whereas a chest x-ray may contain 
only one series. Two or more series may also be displayed simultaneously (e.g., 

25 supine and prone series of a virtual colonoscopy study). A window/level menu. 
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W/L, is available as part of the user-interface which lists preset window and 
level settings (i,e., grayscale settings) for the 2D viewer. The preset settings can 
be specified in an options menu. 

The step of displaying and rendering images, step 3 10, includes altering 
S the display of the images in response to commands from the radiologist. For 
example, the radiologist can pan through a number of images in the 2D viewer 
as the mouse is moved and the LMB is pressed, provided that more than one 
image is contained in the series. Similarly, the 2D viewer can translate (i.e., 
move) the image up/down and sideways when the mouse is moved and the 
10 MMB is pressed. The 2D viewer can also zoom the image display when the 
mouse is moved and the LMB and MMB are pressed simultaneously. An 
overview button is provided in the user- interface to re-center the Image in case 
the scene is moved out of sight. However, re-centering may be unnecessar>- if 
the ability to move or zoom an image is restricted. 
15 A 3D viewer is also provided in the user-interface, as shown in Fig. 6B 

to render innagcs in step 310. A 2D/3D toggle button is also included in the 
user-interface to allow the radiologist to toggle between the 20 and 3D viewers 
at step 310. In the 3D viewer, the mouse operations arc similar to those of the 
2D viewer except that pressing the LMB while moving the mouse causes the 3D 
20 rendered scene to rotate in space. The LMB can also be used to control a "fly- 
through" mode as used in virtual endoscopy as disclosed in U.S. Patent 
5,782,762, 

The 3D viewer incorporates techniques including render around a point 
and hybrid rendering (i.e., combined volume rendering, surface rendering, and 
25 multiplanar [MPR] display). These techniques are the subjects of previous U.S. 
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Patenis 5,782,762 and 5,920,319, the disclosures of which are incorporated 
herein by reference. When surface rendering and MPR are utilized, 
identification of new diagnostically significcnt features^ discussed below, 
within the 3D environment works in the same fashion, with a RMB click. When 
5 the 3D viewer is activated after a diagnostic finding has been created, the 

volume-rendered image, e.g., a cube of CT data, (or surface- rendered or MPR 
image(s) ) is centered around the coordinates of the diagnostic finding, 

A render-box-size menu is also provided in the user-interface to control 
the size of the volume (i.e., cube of digital data) rendered in the 3D viewer. 

10 When changing the volume size, the 3D display automatically adjusts the scene 
to fill the screen. An opacity-map menu, Op, in the 3D viewer permits the 
radiologist to control the level of transparency and grayscale/color scale of a 3D 
volume rendering. 

As a further aspect of the display step 310, an orientation button is 

15 provided in the user-interface to allow the radiologist to properly set the 

orientation of the image data prior to 3D rendering. For example, it is assumed 
that the 2D first image in a CT series is the most superior (i.e., highest) image, 
the patient's left is on the radiologist's right, and the patient's anterior surface is 
facing up. If the series needs to be reoriented, the radiologist can pan through 

20 the collection of images to locate the most superior image (or close to it). The 
radiologist then toggles the orientation button, at which time the 2D viewer goes 
into an orientation mode. The radiologist freely rotates the image plane by 
pressing the LMB and moving the mouse until the proper anterior/posterior and 
left/right orientation is achieved. Finally, the radiologist toggles the orientation 

25 button again to set the proper orientation. The 3D viewer then automatically 
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adjusts the image plane so that it is orthogonal to the radiologist's viewpoint. 
The 3D scene can also be automatically annotated with labeled 3D axes to assist 
in the visual orientation by the radiologist. 

The volume-rendered image can be manipulated in various ways (i.e., 
5 using opacity nnaps, cutting planes^ rotation, and fly-throughs). A second 
method for switching between the 2D and 3D viewers is lo click on a 2D 
thumbnail image representation of a diagnostic finding (or its appended 
secondary 2D and 3D images) shown in an intermediate report display, thereby 
recalling the last state of the 2D or 3D viewer associated with the newly 
1ft activated finding. 

When transitioning between 2D and 3D viewers, the last state of each 
viewer is stored. For example, the proper grayscales (or color scales) and 
opacity maps are applied according to the last recalled W/L or Op settings, 
respectively. Similarly, when jumping to a previous finding by clicking on its 
15 thumbnEiil image representation, the last W/L and/or Op settings for that fmding 
are recalled depending on whether the thumbnail represents a 2D or 3D image. 
A previous button, Pr, allows the radiologist to toggle between the two most 
recent W/L settings or Op settings in the 2D and 3D viewers, respectively. 
Alternatively, the user can press on the LMB followed by a click of the RMB to 
20 activate the Pr function. 

During review of an image using the viewers as described above, the 
radiologist searches for any diagnostically significant image features. When the 
radiologist locates a diagnostically significant feature, the radiologist begins the 
process of recording a diagnostic finding at steps 106 and 3 1 2, The process of 
25 recording a diagnostic finding begins with positioning the cursor over the 
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location of the feature on the digital image and clicking the RMB at step 312. 
Alternatively, when applying the invention to conventional x-rays or images, a 
digital camera device can be pointed at an image finding, and a representative 
digital image can be recorded. Alternatively, the radiologist may point at the 
5 feature by using an intelligent view box. Clicking on the RMB stores the image 
coordinates, for example DICOM coordinales, and an image number 
corresponding to the cursor location in a database. To complele the definition 
of a diagnostic finding, an anatomical: pathological code and, optionally, 
secondary attributes are assigned to the image coordinates and automatically 

10 stored in the database. The anatonnical code identifies the anatomical location 
within the body, and the pathological code describes the pathology of the 
identified feature. The anatomical :pathological codes may be derived from a 
predefined lexicon, such as the American College of Radiology (ACR) Index of 
Radiological Diagnoses or Systematized Nomenclature of Medicine 

15 (SNOMED). The secondary attributes provide additional descriptions of the 
finding and include, for example distance, area and volume measurements, 
characteristics and status of the finding, as well as multimedia information such 
as audiu descriptions, 3D snapshots, and 3D illustrated movies. 

In response to the RMB click the reporting system can automatically 

20 display the anatomical-location menu at step 3 14. The anatomical-location 
menu may consist of a cascading list of anatomical location codes that have 
been customized based on the previously verified OPT and ICD codes; i.e., the 
anatomical-location menu presents only the anatomical organs associated with a 
particular radiologic examination. The cascading anatomical-location menu 

25 provides greater levels of detail of the finding's anatomical location with each 
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cascading level presented. For example, a first level might specify 
"Gastrointestinal System", a second level "Colon", and a thiid level "Sigmoid 
Colon". Upon selection of an anatomical code, the reporting system displays a 
cascading pathology-code menu, at step 3 16, which displays a cascading list of 
5 pathology codes that correspond lo the selected anatomical location. For 

example, a first level of the pathology-code menu might specify "Neoplasm", 
the second "Benign Neoplasm'*, and the third "Polyp". An 
anatomical :pathologicaJ code must be assigned to any unlabeled findings prior 
to final report approval; otherwise, these findings are labeled with the default 
10 "unknown location:unknown pathology" or any combination thereof When a 
diagnostic finding has an indeterminate etiology, the radiologist my assign a list 
of diagnostic possibilities, representing a differential diagnosis, as secondary 
attributes of that finding. Alternately, the reporting system 10 can incorporate 
voice activated control and natuml language processing in conjunction with or 
15 instead of the annotation menus, i.e. the anatomical-location and pathological- 
description menus. The radiologist could speak "Sigmoid Colon Polyp" to 
achieve the same result as using the annotation menus. 

As each diagnostic finding is created, a representative thumbnail image 
620, as shown in Fig. 6, may be displayed on the right side of the 2D and 3D 
20 viewers (or on an independent display monitor) for immediate presentation and 
recall, and the thumbnail images later may be incorporated into the final report. 
Alternately, the report can be displayed on a second monitor as it is being 
created. The above method for entering an anatomical:pathological code is 
denoted "click and label". Two alternative methods are also possible for 
25 performing steps 314 and 316. 
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The first alternative method, "click-pause-label", allows the radiologist 
to postpone assignment of an anatomical :patho]ogical code until sometime later 
during the analysis of the fmding. In this case, the radiologist must deliberately 
press anatomy-location and/or paihoiogy-description button. An and Pa^ on the 
s 2D or 3D viewer, as shown in Fig. 6, to subsequently activate the corresponding 
annotation menu, The second alternative method, "click-click-click and 
label-labeMabel", allows the radiologist to annotate the diagnostic findings 
during fina) report editing. A more detailed description of these two methods is 
discussed below in conjunction with the method of operation of the reporting 

10 system. 

The method of entering and annotating diagnostic findings is not limited 
to computer pull-down menus containing preselected terminology. Keyboard, 
voice recognition, macros, and natural language processing are available to 
enter diagnostic findings and secondary attributes. 
15 After assignment of the anatomical ipathological codes, secondary 

attributes may added at step 318 to embellish or support the diagnosis. As 
shown in Fig. 6, the user-interface 600 of the reporting system 10 includes 
various options for adding secondary attributes. A chart of the symbols used on 
Fig. 6 are set forth in the following chart: 



An 


Annotation menu listing ACR Dx codes 


Vo 


Volume measurement bunon 


Ch 


Characteristic button 


Di 


Distance measurement button 


Ar 


Area measurement button 


Au 


Audio record bunon 


Pt 


Priority button 


Rm 


Recommendation button 
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Sn 


Snapshot button 


Mo 


Movie button 


W/L J. 


Window^ vel presets menu 




Orientation button 




Overview button 


Pr 


Previous window/level setting toggle 
button 


2D/3D 


2D/3D viewer toggle button 


Cr 


Cursor ori/off toggle button 


Series 


Series menu 


MPR 


Multi-planar button 


Surf- 


Surface retidering butlor 


Op J, 


Opacity map presets menu 


« J- 


Render box size menu 




Opaque cutting plane toggle button 



For example, a characteristics button, Ch, is included to activate a menu 
of descriptive attributes that etihance a specific diagnostic code set, (i.e., 
anatomy:pathology code combination). For example, "liver: metastatic 

15 neoplasm from colon" (ACR diagnostic code 761.3375) can be further 
characterized with the number of lesions (i.e., single or multiple), 

A distance-measurement button, Di, is included in the user-interface of 
the reporting system 10 to permit the radiologist to measure a finding in the 2D 
or 3D viewer with any number of diameters. Similarly, an area-measurement 

20 button, Ar, allows the radiologist to define a region-of-interest (ROI) from 
which the cross-sectional area, mean voxel value, and standard deviation of 
voxel values in that region can be calculated. Measurements automatically 
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become secondary attributes of the active diagnostic finding and are stored in 
the database associated with the diagnostic finding. Additionally, a volume- 
measurement button, Vo, is provided to pennit the radiologist to define a 
volume-of -interest VOL The reporting system 10 can create the VOI by 3D 
S segmentation means, as disclosed in U.S. Patents 5,782,762, 5,920,319, and 
6,083,162, each of which are incorporated herein by reference. A volume 
measurement calculated from the VOI may be added as a secondary attribute. 

The reporting system also permits the assignment of both priority levels 
and recommendations to a finding. A priority button, Pt, permits the radiologist 

10 to add a certain level of significance to a diagnostic finding as a secondary 

attribute. A recommendation button, Rm, can be used to label a "leaking aortic 
aneurysm" diagnostic code with "High Priority - Requires immediate attention." 
By default, the reporting system 10 does not assign any particular priority or 
recommendation to a diagnostic finding; however, certain diagnostic codes may 

15 automatically receive priority and recommendation codes. 

An audio button^ Au, is included in the user- interface to allow the 
radiologist to dictate a verbal description of a diagnostic finding, and that audio 
file becomes a secondary attribute of the finding. The audio file can be saved in 
the final report unchanged, or it can be transcribed to text by a typist or a voice 

20 recognition system. 

A snapshot button, Sn, in the user-interface allows the radiologist to 
record any number of additional 2D and 3D images as secondary attributes of a 
diagnostic finding. For example, a "colon ;polyp" diagnostic finding could be 
supported by additional 3D snapshots of the polyp. In the case of 

25 "spine rarthritis" which is seen over a large portion of the skeleton, a single 
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diagnostic finding can be created to establish the diagnosis, and additional 
snapshots of other sites of the disease can support the diagnosis. Alternatively, 
creating multiple individual diagnostic findings documenting arthritis could 
achieve the same result. Additionally, the recording system provides the ability 
5 to place a marking symbol in the 2D or 3D images indicating the location of the 
selected feature. The snapshot function also records the location of the marking 
symbol visible within the 2D or 3D viewer, as well as the state of the 2D or 3D 
viewer at which time the Sn button was pressed. 

A movie button^ Mo, functions in a similar manner by appending cine 

10 clips of moving 2D or 3D images, including active annotations and voice 

descriptions. The active annotations can take the form of freehand notations 
"drawn" over the 2D or 3D images during recording of the cine clip. The drawn 
freehand notations can be siniilar to "chalkboard-style" markings used by 
television commentators to diagram and analyze football plays. 

15 To assist radiologists in establishing a diagnosis, the annotation menus 

may also provide links to reference materials and example images related to 
each potential diagnostic finding. The annotation menus may include options to 
undo accidental RMB clicks. The reporting system 10 also permits the 
radiologist to recall the annotation menus to reassign a diagnostic code to a 

20 particular finding if the diagnosis is revised during the evaluation process. 

The reporting system 10 may also perform computerized diagnoses at 
step 320. For example, computer-assisted polyp detection (CAPD), as disclosed 
in U.S. Patent 5,920 J 19, can be integrated with the system so that 
CAPD-identified polyps can be automatically correlated with 

25 radiologist-defined polyps by correlating the proximity (i.e., Euclidean 
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distances) of image finding coordinates. The identified diagnostic findings can 
be used to support advanced applications, such as the creation of "polyp maps" 
for subsequent endoscopic or surgical guidance. A polyp map consists of a 3D- 
rendcred colon with highlighted polyp locations. 
S Another example of an advanced application that this reporting system 

supports is a Transbronchial Needle Aspiration (TBN A) targeting scheme. The 
TBNA application uses the stored data in the reporting system 10 to 
automatically construct airway models and lymph node targets (i.e., 
surface-rendered models of the anatomy generated using the respective finding 

10 coordinates). TBNA is a bronchoscopy technique that permits a needle biopsy 
of suspicious mediastinal lymph nodes. The tracheobronchial tree and lymph 
nodes are defined by their diagnostic finding coordinates, respectively, and are 
assigned secondary attributes by the radiologist to indicate the TBNA lymph 
nodes as targets. Further refinement of the lymph node targets (i.e., modeling 

15 lymph nodes as spherical or ellipsoid objects) can use the distance^ area, and 

volume measurements that are generated as secondary attributes of those lymph 
nodes. 

After the review of the image(s) is deemed complete, the report display 
is presented for the radiologist to review at step 332. The report display is 

20 invoked by pressing a report button in the user-interface to activate the report 
display. Alternately, when using a two-monitor system or a wide monitor 
display, the report can be shown simultaneously as it is being generated. The 
reporting system 10 sorts the diagnostic findings according to anatomical 
categories, with high priority findings placed at the top of each category. The 

2S reporting system 10 can also order the findings by priority levels, irrespective of 
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anatomical categories. The reporting system 10 highlights each high-priority 
fmdiDg with color-enhanced text The radiologist edits the final report as 
necessary, including linking redundant findings at step 324. 

A powerful feature of the paradigm's report format and database 
5 structure is the ability to link and track diagnostic findings within the same 
examination (i.e., vertical linking) and across serial examinations (i.e., 
horizontal linking). For example, a CT examination generally consists of a 
hierarchy of series/acquisitions/images. A diagnostic finding identified on an 
image within one series may also be seen in another series of the same 

10 examination. The reporting system 10 provides the ability to vertically link 
(i.e., combine) such diagnostic findings within its database. In one 
implementation, the radiologist "drags and drops" a finding onto a matching 
finding in the report display to achieve linking, and the "dropped" finding 
becomes a subset of the primary finding. Alternatively, the reporting system 10 

15 could perform linking via a conmiand-line interface or voice-activated control. 
The purpose of vertical linking is to manage redundancy of report information. 

Similarly, the reporting system 10 provides horizontal Unking as a 
means to track and monitor a diagnostic finding over time and across various 
imaging modalities. In horizontal linking, diagnostic findings can be "dragged 

20 and dropped" across new paradigm reports. In this case, the diagnostic findings 
exist independently in their respective reports and do not necessarily become 
subsets of other findings. Horizontal linking provides a means to efficiently 
analyze a particular diagnostic finding over time. 

An extension of "linking" is "compositing." A group of image findings 

25 (e.g., pleura:pleural effusion, heartrcardiomegaly, lung:pulmonary edema) can 
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be linked Cor composited) by the radiologist or by an artificial intelligence (AI) 
program to yield a cumulative diagnosis of "congestive heart failure." 
Similarly, the radiologist or an Al program can link or composite other clinical 
information (e.g., laboratory values or pathology reports) to support and make a 

5 diagnosis. 

The reporting system 10 also allows for the automatic incorporation of 
repetitive findings frorn previous reports into a new report (e.g., evidence of 
prior gallbladder surgery). If a previous report contains a "trackable" finding 
(e.g., index lymph node measurement)^ that previous finding is brought to the 
10 attention of the radiologist In this case, the frackable finding can be linked 

horizontally across reports, and the temporal progression of this finding can be 
observed in a specialized viewer. 

The report display also includes a suspend-resume button for suspending 
or resuming an examination in case the radiologist is interrupted during the 

15 review. Upon completion of the report, the reporting system 10 stores and 
sends the final report, as shown in Figs. 7A-C, at step 326. The reporting 
system 10 may issue the report by any combination of telephone, fax, pager, or 
e-mail and may include return receipt verification. The automated sending and 
receipt vcnfication allows the radiologist to quickly communicate his or her 

30 findings and track this communication. Along with the prioritized and 

highlighted presentation of the most significant findings, the automated sending 
feature of the reporting system 10 helps to fulfill die radiologist*s duty for 
timely communication of results and follow-up on the findings. 

The reporting system also supports '*real-time dynannic radiology." Each 

25 diagnostic finding is annotated with a timestamp. After an initial report is 
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"signed off/' any future changes to the report can be recorded as a history of the 
report. Any subsequent significant changes can be automatically communicated 
to a clinician and verified upon their receipt. 

The reporting system 10 monitors how the radiologist reviews an 
5 examination. The fmal report can also indicate how much time a radiologist 
spends reviewing an exam, number of findings, and average time per finding. 
Statistics, including total review time, time per finding, number of findings* and 
diagnostic accuracy, are compiled during a review session and are reported as 
needed. This feature creates a utilization management and quality assurance 
10 measure that is appealing to the Health Care Financing Administration (HCFA) 
and health maintenance organizauons (HMOs). 

The final report can also be automatically translated into a foreign 
language using the standardized lexicon of anatomicahpathological codes and 
simple lookup tables. 
IS Healthcare organizations further benefit from the automation and 

efficiency of the system. In particular, billing speed and accuracy are increased. 
Billing requires matching of ICD and CPT codes, a task that currently requires 
highly-trained personnel to decipher radiology reports and verify proper code 
assignments. Incorrect coding results in denied or delayed reimbursement by 
20 insurers. However, the present reporting system automate the process and 
allows radiologists to assume responsibility for coding. 

The method of operation is best illustrated by its application in the field 
of radiology as shown in Fig. 4. Upon starting the software program, the 
radiologist signs in, with either a password or voice signature or any other 
25 security measure, to begin the evaluation at step 400. Secure sign-in protects 
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access to the database and validates the identity of the radiologist generating the 
report. The file loader displays a work list of patients whose examination 
studies are accessible. The radiologist selects the name of a patient at step 402, 
and the flic loader displays all of the associated unread examination files. The 
5 radiologist selects a particular examination file, and that examination file is 
loaded into computer memory. 

The file loader displays the CPT and ICD codes assigned to a particular 
examination. This information can be obtained from the HIS 36 or entered 
manually. The radiologist verifies the CPT and ICD codes and makes any 

10 necessary changes at step 404. Correct assignment of the CPT and ICD codes 

by the radiologist is essential for electronic billing and expedited reimbursement 
by insurers. 

After validation of the CPT and ICD codes, the radiologist begins 
analysis of the first image presented in the 2D viewer or selects an alternate 

15 image, at step 406, from the scries menu which lists all of the images or sets of 
images (i.e., series) in a patient exam available for review. The radiologist may 
change the displayed image in order to locate diagnostically significant features 
in other images at step 408. For example, the radiologist may press the LMB 
while moving the mouse to pan through multiple images in the 2D viewer 

20 (provided that more than one image is contained in the series). The radiologist 
may also translate the displayed image up, down, and sideways by pressing the 
MMB while moving the mouse. The radiologist may also zoom the displayed 
image by pressing the LMB and MMB simultaneously while moving the mouse. 
In the 3D viewer, the mouse operations are similar except that pressing the 

25 LMB while moving the mouse causes the 3D rendered scene to rotate in space 
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or to guide a "fly-through." Alternatively, multiple images or series can be 
displayed simultaneously in separate windows in the viewer. 

To aid in the identification of diagnostically significant features, the 
radiologist may toggle between 2D and 3D viewers by pressing the 2D/3D 

S toggle button as shown in Fig. 6. When the 3D viewer is initially activated, a 
volume-rendered image centered around the coordinates of the identified feature 
is created (i,e., a cube of CT data is volume-rendered). The radiologist may 
adjust the size of the volume (i.e., cube of digital data) that is rendered in the 3D 
viewer via the render-box- size menu. The radiologist may further adjust the 
10 volume-rendered image in various ways, such as using opacity maps, cut planes, 
and rotation. MPR and surface rendering can also be activated in the 3D 
viewer. 

When the radiologist toggles between 2D and 3D viewers, the last slate 
of each viewer is recalled. The radiologist may also toggle between the 3D and 

15 2D viewers by clicking on a primary 2D thumbnail image representation of a 
diagnostic finding (or its supporting secondary 2D and 3D thumbnails), thereby 
recalling the last state of the 2D or 3D viewer associated with the activated 
finding. The cursor position and location of any marking symbols in the display 
are recalled as part of the last state of the viewer. The 2D or 3D viewer then 

20 enters an edit mode, during which the radiologist can append additional 
secondary attributes to the activated diagnostic finding, and these are 
subsequently stored in proper locations within the database. 

The radiologist can also set the orientation of the image data prior to 
image analysis. If an image or image series needs to be reoriented, the 

25 radiologist pans through the volume of images to locate the most superior image 
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(or close to it). Then, the radiologist toggles the orientation button, at which 
time the viewer goes into an orientation mode. The radiologist rotates the 
innage plane by pressing the LMB and moving the mouse until the proper 
anterior/posterior and left/right orientation is achieved. Finally, the radiologist 
5 toggles the orieatation button again to set the proper orientation. The viewer 
automaticaJIy adjusts the 2D image plane so that it is orthogonal to the 
radiologist's viewpoint 

The radiologist has further control over the display of the images such as 
grayscale (or color scale) and 3D opacity maps settings. The iradiologist may 
10 toggle between the two most recent W/L settings or Op settings in the 2D and 
3D viewers by pressing the previous button, Pr, as shown in Fig. 6, or 
simultaneously pressing the LMB and RMB. Additionally, the radiologist may 
toggle a visible cursor on and off by pressing a cursor-toggle button^ Cr, as 
shown in Fig. 6, to indicate the location of a finding in both the 2D and 3D 
15 viewers. By pressing the overview button, the radiologist re-centers a 2D or 3D 
volume-rendered image in case the scene is moved out of sight. 

When the radiologist locates a diagnostically significant feature, the 
radiologist positions the cursor over the location of the feature on the digital 
image and clicks the RMB to mark the feature at step 410. Clicking on the 
20 RMB stores the image coordinates and image number corresponding to the 

cursor location in database. To complete the definition of a diagnostic finding, 
the radiologist annotates the point (location) by assigning an 
anatomicahpathological code and optionally assigning secondary attributes at 
steps 412 and 414. 

25 The radiologist selects an anatomical:pathological code from a 
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predefined lexicon, such as the ACR Index of Radiological Diagnoses or 
SNOMED or a custom designed lexicon, to create a diagnostic finding. As each 
diagnostic finding is created, a representative thumbnail image 620 maybe 
displayed on the right side of the 2D and 3D viewers, or in a separate display, 
5 for immediate review and recall, and the thumbnail images later may be 
incorporated into the final report as shown in Figs 7B and 7C. 

The radiologist enters the anatomicahpathological code by one of several 
modes. In a first mode, "click and label", cascading pop-up annotation menus 
are presented to the radiologist immediately after a feature is marked by an 
10 RMB click at step 500 of Fig. 5 A. The radiologist selects an appropriate 

anatomical location description from the anatomical -location menu at step 502, 
For example, the radiologist may select Gastrointestinal System: Colon; 
Sigmoidal Colon. After the selection, the radiologist selects the pathological 
description from the pathology-description menu at step 502. For example, the 
15 radiologist may select Neoplasm :Benign Neoplasm.Potyp, A secondary 
attribute may then be assigned at step 504. 

In a second mode, "click-click-click and label-label-label", the 
radiologist identifies all the diagnostically significant features first and 
subsequently annotates the features with labels and secondary' attributes. As 
20 shown in Fig. 5B, the radiologist marks a designated feature at step 550 and then 
proceeds to mark successive features by repeating step 550. After all desired 
features are marked, the radiologist assigns a diagnostic code to each marked 
feature by assigning an anatomical code at step 552 and a pathological code at 
step 554. Secondary attributes are assigned at step 556 either following the 
25 marking of a feature at step 550 or the assigning of anatomical and 
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pathological codes at steps 552 and 554. The radiologist must assign a 
diagnostic code to any unlabeled findings prior to final report approval; 
otherwise, these findings may be labeled with a default "unknown 
location: unknown pathology." Addilionally, the radiologist may recall the 
5 annotation menus to reassign an anatomical rpathological code to a particular 
finding if the diagnosis needs to be revised during the evaluation process. 

The radiologist may also assign secondary attributes to embellish or 
support a diagnostic finding at step 4 14, but secondary attributes are not 
essential for establishing a diagnostic finding. The radiologist may enter 
10 descriptive characteristics, dimensional measurements, audio descriptions, and 
specific snapshots of particular views of the identified finding as secondary 
attributes. For example, the radiologist may add descriptive characteristics that 
enhance a specific diagnostic code set from a characteristics menu of descriptive 
characteristics. 

15 The radiologist may measure one or more dimensions of a finding, for 

example, a diameter of an identified feature in the 2D or 3D image. The 
radiologist activates the distance measuring function by pressing the distance- 
measurement button, Di, as shown in Fig. 6. The radiologist measures the 
distance by clicking on first and second object points which span the 

20 characteristic length. Similarly, the radiologist may measure the area of an 

identified feature by pressing the area-measurement button, Ar, as shown in Fig. 
6 and defining a region-of-interest (ROI) using the input device 27. The 
cross-sectional area, mean voxel value, and standard deviation of voxel values 
in the ROI can be calculated. The radiologist may also add a volume- 

25 measurement as a secondary attribute by pressing the volume-measurement 
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button, Vo» as shown in Fig. 6. 

As pari of step 414» the radiologist may also add a priority level and 
recommendation to the diagnostic finding by pressing the priority button, Pt, or 
recommendation button, Rra, respectively, as shown in Fig. 6. In addition, the 
5 radiologist may append a verbal description of the diagnostic fmding in the form 
of an audio file. To add a verbal description the radiologist presses the audio 
button, Au, as shown in Fig. 6 to initiate recording and then dictates a verbal 
description of the diagnostic finding. The radiologist presses the audio button 
again to stop recording, and an audio fde of the verbal description is stored in 

10 the database attached to the finding. Audio files can be attached to the '^global" 
finding or attached to individual snapshot iniages or movies. 

Additionally, the radiologist may record snapshots of any of the 
displayed 2D and 3D images as a secondary attribute by pressing the snapshot 
button. Sn, as shown in Fig. 6. For example, the radiologist may record any 

15 number of additional images showing differing views of a particular 

diagnostically significant feature. For example, a "coIon:polyp" diagnostic 
finding could be supported by additional 3D snapshots of the polyp. The 
radiologist may also append cine clips of moving 2D or 3D images (including 
audio and active annotations) as a secondary attributes in a manner similar to 

20 recording snapshots by pressing the movie button. Mo, as shown in Fig. 6. 
Pressing of the movie button starts and stops the recording of the cine clip. 

Prior to fmal report review, the radiologist may also invoke computer- 
aided location and analysis of diagnostically significant features, at step 416, 
whereby the system automatically identifies and diagnoses suspicious features. 

25 For example, the radiologist can review polyps found by the CAPD that were 
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not previously identified by the radiologist. 

After the radiologist's review is deemed complete, the radiologist clicks 
a report button on the bottom of either the 2D or 3D viewer as shown in Figs, 6 
»o activate the report display at step 418. Alternately, the report can be 
S generated and simultaneously displayed on a second monitor while the 

diagnostically signincant findings are being located and coded. The diagnostic 
findings are sorted according to anatomical categories and priorities, with high 
priority fmdiags being placed at the top of each category. Each high-priority 
finding is highlighted with color-enhanced text. The sorting and highlighting of 
10 the diagnostic findings aJens the end-user to the most significant diagnostic 
findings- 

The radiologist edits the final report as necessary, including linking 
redundant findings at step 420. The step of creating links, step 420, may be 
performed before or after the step of reviewing the report, step 418, as depicted 

15 in Fig. 1, where the step of creating the links, step 1 10, occurs prior to the step 
of reviewing the report, step 1 12. In one implementation of vertical linking, the 
radiologist "drags and drops" a finding onto a matching finding in the same 
report display, and the "dropped" finding becomes a subset of the primary 
finding. Alternatively, the radiologist can form links via a command-line 

20 interface or voice- activated conunands (control). Similarly, ±e radiologist may 
assign horizontal linking to track and monitor a diagnostic finding over time and 
across various imaging modalities. In horizontal linking, diagnostic findings 
can be "dragged and dropped" across new paradigm reports in a sinoilar 
fashion. 

25 The radiologist may also composite a group of image findings to yield a 
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diagnosis as illustrated above for "congestive heart failure." In this process, the 
radiologist or an AI program can link (or composite) additional clinical 
informaiion (e.g., laboratory and pathology report values) to support a 
diagnosis- 

5 The radiologist further reviews any repetitive diagnostic findings from 

previous reports which are brought to die attention of the radiologist by the 
system. If a previous report contains a repetitive diagnostic finding (e,g-, 
evidence of prior gallbladder surgery), that finding is presented to the 
radiologist for automatic incorporation into the new report. If a previous report 

10 contains a "trackable" diagnostic finding (e.g., index lymph node measurement), 
the radiologist can link the trackable diagnostic findings horizontally across 
reports, and the temporal progression of this diagnostic finding can be observed 
in a specialized viewer. 

The radiologist can suspend an examination for later resumption by 

15 pressing the suspend-resume butlon during the review. Upon completion of the 
report the radiologist instructs the system to send the report to the end-users 
(e.g., clinicians) at step 422. Additionally, the end-user can access the report 
via a Web server after the report has been posted. As noted above, the report 
may be sent by a combination of telephone, fax, pager, or e-mail and may 

20 include return receipt verification. The automated sending and receipt 

verification allows the radiologist to quickly communicate his or her findings 
and verify this communication. 

End-users receiving the radiologist's report can customize the display of 
the information to best suit their needs. For example, the clinician can click on 

25 a thumbnail unage in the final report to access the original PACS image data. 
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Additionally, the reporting system can automatically translate the radiologist's 
report into a different language for the end-user. The standardized lexicon of 
diagnostic findings supports rapid translation of reports to foreign languages by 
employing translation look-up tables. 
5 The reporting system of the present invention has further application 

beyond the preparation and delivery of reports. The ability of tlie reporting 
system to enter diagnostic findings into searchable databases readily supports 
data mining for clinical trials, epidemiology studies, and outcomes analyses. 
Additionally, the reporting paradigm supports radiologic training. For 
10 example, a radiology resident can issue a preliminary report indicating his or her 
findings, and the preliminary report can later be modified by an attending 
radiologist to indicate any corrections. In the latter case, the system 
automatically informs the referring clinician of any significant changes. The 
history of report changes can be recorded with each finding (or changed 
15 finding) having a limestamp. The reporting scheme also supports standardized 
testing (e.g., replacement of the American Board of Radiology's Oral Board 
examination) by objectively measuring a student's performance. Such an 
objective performance measure could also assist in comparing a radiologist's 
performance to that of a n on -radiologist. 

These and other advantages of the present invention will be apparent to 
those skilled in the art from the foregoing specification. Accordingly, it will be 
recognized by those skilled in the art that changes or modifications may be 
made to the above-described embodiments without departing from the broad 
inventive concepts of the invention. For example, while the above invention 
has been illustrated in terms of its application to the field of radiology, the 
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invention is equally applicable to other fields of medicine as well as other intiage analysis 
fields such as satellite imagery and photography. It should therefore be understood that 
this invention is not limited to the particular embodiments described herein, but is 
intended to include all changes and modifications that are within the scope and spirit of 
5 the invention as set forth in the claims. 

Throughout this specification and the claims which follow, unless the context 
requires otherwise, the word "comprise", and variations such as "comprises" or 
"comprising", will be understood to imply the inclusion of a stated integer or step or group 
1 0 of integers or steps but not the exclusion of any other integer or step or group of integers or 
steps. 

The reference to any prior art in this specification is not, and should not be taken 
as, an acknowledgement or any form of suggestion that that prior art forms part of the 
1 5 common general knowledge in Australia. 
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Claims defining the present invention are as follows: 

1. A computer implemented method for analysis of an image comprising the 
steps of: 

displaying an actual image of an object in an image viewer to a user for analysis of the 

image; 

associating image content information describing the image type with the image; 

analyzing the image to identify a feature of interest of the object; 

identifying a location of the feature using an input device to selectively mark a 
location on the actual image representing image coordinates of the identified feature; 

associating a position descriptor with the location of the feature, the position 
descriptor representing image coordinates; 

compiling a list of user-selectable items related to the image content information to 
present to the user; 

selecting at least one item from the list, the item describing a characteristic of the 
feature; and 

creating an image finding of the feature comprising the position descriptor and the at 
least one selected item. 

2. A method according to claim 1 comprising associating a status of the viewer 
with the feature, the status comprising at least one of an orientation, a magnification, and a 
shading of the image, and wherein the image finding comprises the viewer status. 

3. A method according to claim 1 wherein the at least one list item comprises a 
location-code which describes the location of the feature relative to an object depicted in the 
image. 

4. A method according to claim 3 wherein the location-code represents an 
anatomical location. 

5. A method according to claim 1 wherein the image content information 
comprises one or more of a CPT code and a ICD code. 
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6. A method according to claim 3 wherein the location-code is selected from a 
predefined lexicon of location-codes. 

7. A method according to claim 3 wherein the at least one list item comprises a 
description-code which describes at least one property of the feature. 

8. A method according to claim 7 wherein the description-code is selected from a 
predefined lexicon of description-codes. 

9. A method according to claim 1 comprising associating at least one of a 
dimensional measurement, mean voxel value, standard deviation of voxel values, an audio 
description, a two-dimensional image, a three-dimensional rendered image, a video 
description, and a user-defmed illustration with the finding. 

1 0. A method according to claim 1, wherein the image content information 
denotes that at least one specific object is depicted within the image. 

11. A method according to claim 7 wherein the property includes a pathology of 
the feature. 

12. A method according to claim 1 wherein the selected item is entered using 
voice recognition. 

13. A method according to claim 1 comprising the step of assigning a priority to 
the image finding to denote the importance of the image finding. 

14. A method according to claim 1 comprising the step of assigning a 
recommendation to the image finding to denote a recommended action to be taken with 
respect to the image finding. 



-36- 



-34- 



15. A method according to claim 1 comprising the steps of creating at least one 
thumbnail image of the feature and associating the thumbnail image with the image finding. 

16. A method according to claim 15 comprising the step of displaying the 
thumbnail image. 

17. A method according to claim 1 comprising the step of displaying the image in 
at least one of a two-dimensional viewer and a three-dimensional viewer. 

1 8. A method according to claim 17 wherein the image is formed by at least one of 
volume rendering, surface rendering, and rendering about a point. 

19. A method according to claim 17 comprising the step of displaying multiple 
images simultaneously. 

20. A method according to claim 1 wherein the image includes a digital image. 

21 . A method according to claim 1 wherein the image is part of a series of two- 
dimensional images associated with a three-dimensional body. 

22. A method according to claim 1 comprising the step of identifying features in 
the image using computer analysis of the image to provide computer identified features. 

23. A method according to claim 22 comprising the step of correlating the 
computer identified features with the feature. 

24. A method according to claim 22 wherein the computer analysis includes 
computer assisted polyp detection. 

25. A method according to claim 22 wherein the computer analysis includes a 
transbronchial needle aspiration targeting scheme. 
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26. A method according to claim 1 comprising creating a plurality of image 
findings. 

27. A method according to claim 26 comprising the step of linking selected 
findings of the plurality of image findings to create a cumulative finding encompassing the 
plurality of image findings. 

28. A method according to claim 26 comprising the step of linking related findings 
to associate the related findings to render the associated findings retrievable as a unit. 

29. A method according to claim 26 comprising the steps of assigning a priority to 
at least one of the image findings and sorting the image findings according to priority. 

30. A method according to claim 26 comprising the steps of assigning a location- 
code to at least one of the image findings and sorting the image findings according to 
location-code. 

31. A method according to claim 26 comprising the step of assigning a 
description-code to at least one of the image findings and sorting the image findings 
according to the description-code. 

32. A method according to claim 1 comprising the steps of 
retrieving at least one prior finding from a previous analysis of an image and 
linking the retrieved image finding to the image finding of the feature, 

whereby a set of findings is created describing a chronology of the image finding of 
the feature. 

33. A method according to claim 1 comprising the step of generatmg a report 
based on the image finding. 
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34. A method according to claim 1 comprising the step of recording a cine clip 
showing a time varying characteristic of the feature. 

35. A method according to claim 33 wherein the report contains at least one of the 
image finding, a thumbnail image of an image finding, and a chronology of an image finding. 

36. A computer implemented method for analysis of image data comprising the 
steps of: 

displaying at least one image of an object; 

recording in a database a position within the image of a selected feature of the object; 

recording in the database a location-code which denotes the location of the selected 
feature relative to the object; 

recording in the database a description representing at least one physical property 
associated with the selected feature; and 

creating an image finding of the selected feature comprising the position, the location- 
code, and the description. 

37. A method according to claim 36 wherein the location-code represents an 
anatomical location. 

38. A method according to claim 36 wherein the step of recording the location- 
code comprises the steps of providing a list of location-codes and selecting a location-code 
from the location-code list. 

39. A method according to claim 38 wherein the list of location-codes is compiled 
fi'om a predefined lexicon of location-codes. 

40. A method according to claim 36 wherein the step of recording the description 
comprises the step of recording a description-code denoting a selected characteristic of the 
selected feature. 
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41. A method according to claim 40 wherein the step of recording the description- 
code comprises the steps of providing a list of description-codes and selecting from the 
description-code list a description-code which describes at least one physical property of the 
selected feature, 

42. A method according to claim 41 wherein the list of description-codes is 
compiled from a predefined lexicon of description-codes. 

43. A method according to claim 41 wherein the image data includes a content- 
code denoting that at least one specific object is depicted within the image. 

44. A method according to claim 43 wherein the description-code list contains 
description-codes that are consistent with the content-code. 

45. A method according to claim 43 comprising providing a location-code list 
containing location-codes that are consistent with the content-code. 

46. A method according to claim 36 wherein the physical property includes a 
pathology of the selected feature. 

47. A method according to claim 36 wherein the step of recording the description 
comprises the step of assigning at least one attribute to the image finding. 

48. A method according to claim 47 wherein the attribute includes at least one of a 
dimensional measurement, mean voxel value, standard deviation of voxel values, an audio 
description, a two-dimensional image, a three-dimensional rendered image, a video 
description, and a user-defined illustration. 

49. A method according to claim 36 comprising the step of creating at least one 
thumbnail image of the selected feature, associating the thumbnail image with the image 
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finding, and recording the thumbnail image in the database. 

50. A method according to claim 49 comprising the step of displaying the 
thumbnail image wherein selection of the thumbnail image recalls the associated image 
finding. 

51. A method according to claim 36 comprising the step of displaying the image 
includes display in at least one of a tvvo-dimensional viewer and a three-dimensional viewer. 

52. A method according to claim 51 wherein the image is formed by at least one of 
volume rendering, surface rendering, and rendering about a point. 

53. A method according to claim 51 comprising the step of displaying multiple 
images simultaneously, 

54. A method according to claim 36 wherein the image data includes a digital 

image. 

55. A method according to claim 36 wherein the image data includes a series of 
two-dimensional images associated with a three-dimensional body. 

56. A method according to claim 36 comprising the step of identifying features in 
the image using computer analysis of the image to provide computer identified features. 

57. A method according to claim 56 comprising the step of correlating the 
computer identified features with the selected feature. 

58. A method according to claim 36 comprising creating a plurality of image 
findings. 

59. A method according to claim 58 comprising the step of generating a report 
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based on the image findings. 

60. A method according to claim 36 comprising the step of recording a cine clip 
showing a time varying characteristic of the selected feature. 

61. A method according to claim 59 wherein the step of generating the report 
comprises incorporating a cumulative finding by linking selected findings of the plurality of 
image findings to create the cumulative finding encompassing the plurality of image findings. 

62. A method according to claim 59 wherein the step of generating the report 
comprises incorporating a primary finding by linking related findings to associate the related 
findings to create the primary finding. 

63. A method according to claim 59 wherein the step of generating the report 
comprises the step of assigning a priority to at least one of the image findings and sorting 
image findings according to priority. 

64. A method according to claim 59 wherein the step of generating the report 
comprises the step of sorting image findings according to at least one of the location-code and 
the description-code. 

65. A method according to claim 59 wherein the step of generating the report 
comprises incorporating a chronology of an image finding by 

retrieving at least one previous finding associated with the selected feature fi-om a 
previous analysis and linking the retrieved image finding to the image finding of the selected 
feature whereby the chronology of the image finding of the selected feature is created. 

66. A method according to claim 1 including the steps of displaying a selected 
portion of the image and selecting of the displayed portion of the image to recall the 
associated diagnostic finding. 
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67. A method according to claim 1 wherein the image includes a plurality of views 
having differing perspectives of the feature. 

68. A method according to claim 59 wherein the step of generating the report 
comprises computing a selected statistical measure of the report generation process. 

69. A method according to claim 68 wherein the statistical measure includes at 
least one of total review time, time per finding, number of findings, and diagnostic accuracy. 

70. A method according to claim 60 comprising generating billing information to 
create a bill for the report. 

71. A method according to claim 1 wherein the image content information 
includes an image content-code, denoting what the image data depicts, and includes reason- 
code, denoting a reason for creating the image data. 

» 72. A method according to claim 71 comprising the step of ensuring that the 

. image content-code and reason-code are compatible. 

: 73. A system for the analysis of image data comprising: 

: a display for displaying at least one image of an object; 

a position selector for marking a position within the image of a selected feature of the 

object; 

' a location selector for selecting a location-code which denotes the location of the 

selected feature relative to the object; 
* a description selector for selecting a description representing at least one physical 

property associated with the selected feature; and 

an image finding generator for creating an image finding comprising the selected 

position, the selected location-code, and the selected description. 

74. A system according to claim 73 wherein the physical property includes at least 



-43- 



-41 - 



one of a dimensional measurement, a location of the feature relative to the object, a mean 
voxel value, a standard deviation of voxel values, an audio description, a two-dimensional 
image, a three-dimensional rendered image, a video description, and an user-defined 
illustration. 

75. A system according to claim 73 wherein the location selector comprises a list 
generator for creating a list of location-codes from which a location-code is selectable. 

76. A system according to claim 75 wherein the location-code represents an 
anatomical location. 

77. A system according to claim 75 wherein the list of location-codes is compiled 
from a predefined lexicon of location-codes. 

78. A system according to claim 75 comprising a file loader for retrieving a 
content-code associated with the image, the content-code denoting that at least one specific 
object is depicted within the image. 

79. A system according to claim 78 wherein the list generator comprises a 
location-code selector for providing a location-code list containing location-codes that are 
consistent with the content-code. 

80. A system according to claim 73 wherein the description selector comprises a 
list generator for creating a list of description-codes from which a description-code is 
selectable. 

81. A system according to claim 80 wherein the description-code represents a 
physical property of the selected feature, 

82. A system according to claim 80 wherein the description-code represents a 
pathology of the selected feature. 
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83. A system according to claim 80 wherein the list of description-codes is 
compiled from a predefined lexicon of description-codes. 

84. A system according to claim 80 comprising a file loader for retrieving a 
content-code associated with the image, the content-code denoting that at least one specific 
object is depicted within the image. 

85. A system according to claim 84 wherein the list generator comprises a 
description-code selector for providing a description-code list containing description-codes 
that are consistent with the content-code. 

86. A system according to claim 73 comprising a communication interface for 
communication with at least one of the Internet, an e-mail system, a fax, a telephone, a 
wireless communications system, a pager, a cellphone, a hospital information system, a 
radiology information system, and a picture archiving and communication system. 

87. A system according to claim 73 comprising an image extractor for creating at 
least one thumbnail image of the selected feature, associating the thumbnail image with the 
image finding, and recording the thumbnail image in the database. 

88. A system according to claim comprising a renderer for creating the image to 
include at least one of volume rendering, surface rendering, and rendering about a point. 

89. A system according to claim 73 comprising an image analyzer for providing 
computer assisted detection of a selected attribute. 

90. A system according to claim 89 wherein the selected attribute comprises a 

polyp. 

91. A system according to claim 90 comprising a link generator for linking the 
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attribute to the diagnostic finding. 

92. A system according to claim 73 comprising a file loader for retrieving a 
plurality of image findings and a finding compositor for linking selected findings of the 
plurality of image findings to create a cumulative finding. 

93. A system according to claim 73 comprising a file loader for retrieving a prior 
finding and comprising a link generator for linking the retrieved image finding to the image 
finding of the selected feature, whereby a set of findings is created describing a chronology of 
the image finding. 

94. A system according to claim 73 comprising a report generator for creating a 
report comprising the diagnostic finding. 

95. A system according to claim 73 comprising a bill generator for creating a bill 
based on the diagnostic finding. 

96. A system according to claim 73 comprising a file loader for retrieving an 
image content-code associated with the image, denoting what the image data depicts, and for 
retrieving a reason-code associated with the image, denoting a reason for creating the image 
data and for comparing the image content-code to the reason-code. 

97. A method according to claim 1, wherein the list of user-selectable items is at 
least a subset of a comprehensive list of user selectable items. 

98. A method according to claim 2, wherein the orientation comprises at least one 
of a translation state and a rotation state. 

99. A method according to claim 2, wherein the magnification comprises a degree 
of image zoom. 
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100. A method according to claim 2, wherein the shading comprises at least one of 
a gray scale setting and opacity setting. 

101 . A method according to claim 36, wherein the orientation comprises at least 
one ofa translation state and a rotation state. 



102. A method according to claim 36, wherein the magnification comprises a 
.... degree of image zoom. 

llll^ 1 03. A method according to claim 36, wherein the shading comprises at least one of 

a gray scale setting and opacity setting. 

104. A system for analyzing an image, comprising: 
•t., a display for displaying an actual image of an object in an image viewer to a user for 

analysis of the image; 

:*: ; a content information retriever for retrieving image content information describing the 

image type and for associating the content information with the image; 
*>;/•• an mput device for markmg a location on the actual image representing image 

* *U . . • coordinates of an image feature; 

a Ust compiler for compiling a list of user-selectable items related to the image content 
:'; information and for presentation the list to the user; and 

an image finding generator for creating an image finding of the feature comprising the 
image coordinates of the image feature and at least one item selected by the user from the list. 



105. A system according to claim 104, comprising a viewer status recorder for 
associating a status of the viewer with the feature, the status comprising at least one of an 
orientation, a magnification, and a shading of the image. 

106. A system according to claim 105, wherein the orientation comprises at least 
one of a translation state and a rotation state. 
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1 07. A system according to claim 1 05, wherein the magnification comprises a 
degree of image zoom, 

108. A system according to claim 1 05, wherein the shading comprises at least one 
of a gray scale setting and opacity setting. 

109. A system according to claim 104, wherein the list items comprise a location- 
code which describes the location of the feature relative to an object depicted in the image. 

1 10. A system according to claim 107, wherein the location-code represents an 
anatomical location, 

111. A system according to claim 107, wherein the location-code is selected from a 
predefined lexicon of location-codes. 

112. A system according to claim 107, comprising a finding sorter for sorting a 
plurality of image findings according to location-code. 

113. A system according to claim 104, wherein the list items comprise a 
description-code which describes at least one property of the feature. 

114. A system according to claim 113, comprising a finding sorter for sorting a 
plurality of image findings according to description-code. 

115. A system according to claim 113, wherein the description-code is selected 
from a predefined lexicon of description-codes. 

116. A system according to claim 113, wherein the property includes a pathology of 
the feature. 

117. A system according to claim 104, wherein the image content information 
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comprises one or more of a CPT code and a ICD code. 

118. A system according to claim 1 04, comprising a finding annotator for 
associating at least one of a dimensional measurement, mean voxel value, standard deviation 
of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered 
image, a video description, and a user-defmed illustration with the finding. 

119. A system according to claim 1 04, comprising a voice recognition unit for 
entering the selected item. 

120. A system according to claim 104, wherein the finding generator is configured 
to associate a priority with the image finding to denote the importance of the image finding. 

121. A system according to claim 1 1 8, wherein the finding generator is configured 
to sort the image findings according to priority. 

1 22. A system according to claim 1 04, wherein the finding generator is configured 
to associate a recommendation with the image finding to denote a recommended action to be 
taken with respect to the image finding. 

1 23. A system according to claim 1 04, comprising a thumbnail generator for 
creating at least one thumbnail image of the feature and associating the thumbnail image with 
the image finding, 

124. A system according to claim 1 04, wherein the viewer comprises at least one of 
a two-dimensional viewer and a three-dimensional viewer. 

125. A system according to claim 104, comprising a Tenderer for generating the 
image by at least one of volume rendering, surface rendering, and rendering about a point. 

126. A system according to claim 104, comprising an image analyzer for 
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identifying features in the image using computer analysis of the image to provide computer 
identified features. 

127. A system according to claim 126, wherein the image analyzer is configured to 
correlate the computer identified features with the feature. 

128. A system according to claim 122, wherein the image analyzer is configured to 
perform computer assisted polyp detection. 

129. A system according to claim 122, wherein the image analyzer is configured to 
perform a transbronchial needle aspiration targeting scheme. 

130. A system according to claim 104, comprising a finding compositor for linking 
selected findings of a plurality of image findings to create a cumulative finding comprising 
the plurality of image findings. 

131. A system according to claim 104, comprising a file loader for retrieving at 
least one prior finding from a previous analysis of an image and for linking the retrieved 
image finding to the image finding of the feature, whereby a set of findings is created 
describing a chronology of the image finding of the feature. 

132. A system according to claim 104, comprising a report generator for generating 
a report based on the image finding. 

133. A system according to claim 132, wherein the report contains at least one of 
the image finding, a thumbnail image of the image finding, and a chronology of the image 
finding, 

1 34. A system according to claim 104, wherein the list of user-selectable items is at 
least a subset of a comprehensive list of user selectable items. 
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135. A system according to claim 104, comprising a communication interface for 
communication with at least one of the Internet, an e-mail system, a fax, a telephone, a 
wireless communications system, a pager, a cell phone, a hospital information system, a 
radiology information system, and a picture archiving and communication system. 

136. A system for analyzing an image, comprising: 

display means for displaying an actual image of an object in an image viewer to a user 
for analysis of the image; 

content information retrieval means for retrieving image content information 
describing the image type and for associating the content information with the image; 

input means for marking a location on the actual image representing image 
coordinates of an image feature; 

list compilation means for compiling a list of user-selectable items related to the 
image content information for presentation to the user; and 

finding creation means for creating an image finding of the feature comprising the 
image coordinates of the image feature and at least one item selected by the user fixim the list. 

137. A system according to claim 136, comprising a viewer status association 
means for associating a status of the viewer with the feature, the status comprising at least 
one of an orientation, a magnification, and a shading of the image. 

138. A system according to claim 1 37, wherein the orientation comprises at least 
one of a translation state and a rotation state. 

1 39. A system according to claim 1 37, wherein the magnification comprises a 
degree of image zoom. 

140. A system according to claim 137, wherein the shading comprises at least one 
of a gray scale setting and opacity setting. 

141. A system according to claim 136, wherein the list items comprise a location- 
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code which describes the location of the feature relative to an object depicted in the image. 

142. A system according to claim 141, wherein the location-code represents an 
anatomica] location. 

143. A system according to claim 141 , wherein the location-code is selected from a 
predefined lexicon of location-codes. 

1 44. A system according to claim 141, comprising a sorting means for sorting a 
plurality of image findings according to location-code. 

145. A system according to claim 136, wherein the list items comprise description- 
codes which describes at least one property of the feature. 

146. A system according to claim 145, comprising a sorting means for sorting a 
plurality of image findings according to description-code. 

1 47. A system according to claim 1 45, wherein the description-code is selected 
from a predefined lexicon of description-codes. 

1 48. A system according to claim 1 45, wherein the property includes a pathology of 
he feature. 

149. A system according to claim 1 36, wherein the image content information 
comprises one or more of a CPT code and a ICD code. 

150. A system according to claim 136, an annotation association means for 
associating at least one of a dimensional measurement, mean voxel value, standard deviation 
of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered 
image, a video description, and a user-defined illustration with the finding. 
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151. A system according to claim 1 36, comprising a voice recognition unit for 
entering the selected item. 

1 52. A system according to claim 1 36, wherein the finding creation means is 
configured to associate a prionty with the image finding to denote the importance of the 
image finding. 

153. A system according to claim 152, wherein the finding creation means is 
configured to sort the image findings according to priority. 

154. A system according to claim 136, wherein the finding creation means is 
configured to associate a recommendation with the image finding to denote a recommended 
action to be taken with respect to the image finding. 

155. A system according to claim 136, comprising a thumbnail creation means for 
creating at least one thumbnail image of the feature and associating the thumbnail image with 
the image finding. 

156. A system according to claim 136, wherein the viewer comprises at least one of 
a two-dimensional viewer and a three-dimensional viewer. 

157. A system according to claim 136, comprising a rendering means for rendering 
the image by at least one of volume rendering, surface rendering, and rendering about a point. 

158. A system according to claim 136, comprising an image analysis means for 
analyzing the image to identify features in the image using computer analysis of the image to 
provide computer identified features. 

159. A system according to claim 158> wherein the image analysis means is 
configured to correlate the computer identified features with the feature. 
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160. A system according to claim 158, wherein the image analysis means is 
configured to perform computer assisted polyp detection. 

16L A system according to claim 1 58, wherein the image analysis means is 
configured to perform a transbronchial needle aspiration targeting scheme. 

162. A system according to claim 1 36, comprising a finding linking means for 
linking selected findings of a plurality of image findings to create a cumulative finding 
comprising the plurality of image findings. 

163. A system according to claim 136, comprising a file retrieval means for 
retrieving at least one prior finding firom a previous analysis of an image and for linking the 
retrieved image finding to the image finding of the feature, whereby a set of findings is 
created describing a chronology of the image finding of the feature. 

164. A system according to claim 136, comprising a report creation means for 
generating a report based on the image finding. 

165. A system according to claim 164, wherein the report contains at least one of 
the image finding, a thumbnail image of the image finding, and a chronology of the image 
finding. 

166. A system according to claim 136, wherein the list of user-selectable items is at 
least a subset of a comprehensive Ust of user selectable items. 

1 67. A system according to claim 136, comprising a communication means for 
communication with at least one of the Internet, an e-mail system, a fax, a telephone, a 
wireless communications system, a pager, a cell phone, a hospital information system, a 
radiology information system, and a picture archiving and communication system. 

168. A system for analyzing an image, comprising: 
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a display for displaying an actual image of an object in an image viewer to a user for 
analysis of the image; 

an input device for marking a location on the actual image representing image 
coordinates of an image feature; 

a viewer status recorder for associating a status of the viewer with the feature, the 
status comprising at least one of an orientation, a magnification, and a shading of the image; 

a location-code list compiler for compiling a list of user-selectable location-codes 
describing the location of the feature relative to the object; 

a description-code list compiler for compiling a list of user-selectable description- 
codes describing a characteristic of the feature; and 

an image finding generator for creating an image finding of the feature comprising the 
image coordinates of the image feature, the viewer status, at least one location-code selected 
by the user from the location-code list, and at least one description-code selected by the user 
from the description-code list. 

169. A system according to claim 1 68, wherein the location-code represents an 
anatomical location. 

1 70. A system according to claim 1 68, wherein the list of location-codes is 
compiled from a predefined lexicon of location-codes, 

1 71. A system according to claim 1 68, wherein at least one of the location-code list 
and the description-code list is at least a subset of a comprehensive list of user selectable 
items. 

1 72. A system according to claim 168, comprising a content-code retriever for 
retrieving a content-code, denoting what the image data depicts, and for retrieving a reason- 
code, denoting a reason for creating the image data. 

173. A system according to claim 1 68 wherein the charactenstic describes at least 
one physical property of the feature. 



-55- 



-53- 



174. A system according to claim 168, wherein the characteristic includes a 
pathology of the feature. 

^ 175. A system according to claim 168, wherein the list of description-codes is 
compiled from a predefined lexicon of description-codes. 

1 76. A system according to claim 1 68, comprising a content-code retriever for 
retrieving a content-code and associating the content-code with the image, the content-code 
denoting that at least one specific object is depicted within the image, and wherein the 
location-code list is assembled to contain location-codes that are consistent with the content- 
code. 

1 77. A system according to claim 1 68, comprising a content-code retriever for 
retrieving a content-code and associating the content-code with the image, the content-code 
denoting that at least one specific object is depicted within the image, and wherein the 
description-code list is assembled to contain description-codes that are consistent with the 
content-code. 

178. A system according to claim 168, comprising a finding annotator for 
associating at least one of a dimensional measurement, mean voxel value, standard deviation 
of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered 
image, a video description, and a user-defined illustration with the finding. 

179. A system according to claim 168, comprising a thumbnail generator for 
creating at least one thumbnail image of the feature and associating the thumbnail image with 
the image finding. 

1 SO. A system according to claim 168, wherein the viewer comprises at least one of 
a two-dimensional viewer and a three-dimensional viewer. 
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181. A system according to claim 180, comprising a rendering means for rendering 
the image by at least one of volume rendering, surface rendering, and rendering about a point. 

182. A system according to claim 168, comprising an image analyzer for 
identifying features in the image using computer analysis of the image to provide computer 
identified features, 

183. A system according to claim 182, wherein the image analyzer is configured to 
correlate the computer identified features with the feature. 

1 84. A system according to claim 168, comprising a report generator for generating 
a report based on the image finding. 

185. A system according to claim 184, comprising a finding linking means for 
linking selected findings of a plurality of image findings to create a cumulative finding 
comprising the plurahty of image findings. 

186. A system according to claim 1 84, wherein the report generator is configured to 
assign a priority to at least one of a plurality of image findings and to sort the image findings 
according to priority. 

1 87. A system according to claim 1 84, wherein the report generator is configured to 
sort image findings according to at least one of the location-code and the description-code. 

1 88- A system according to claim 1 84, comprising a file loader for retrieving at 
least one prior finding from a previous analysis of an image and for linking the retrieved 
image finding to the image finding of the feature, whereby a set of findings is created 
describing a chronology of the image finding of the feature. 

1 89. A system according to claim 1 84, wherein the report generator is configured to 
compute a selected statistical measure of the report generation process. 
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1 90. A system according to claim 1 89, wherein the statistical measure includes at 
least one of total review time, time per finding, number of findings, and diagnostic accuracy. 

191. A system according to claim 168, comprising a bill generator for creating a bill 
based on the diagnostic finding. 

192. A system according to claim 168, wherein the finding generator is configured 
to associate a recommendation with the image finding to denote a recommended action to be 
taken with respect to the image finding. 

1 93. A system according to claim 1 68, wherein the orientation comprises at least 
one of a translation state and a rotation state. 

1 94. A system according to claim 1 68, wherein the magnification comprises a 
degree of image zoom. 

195. A system according to claim 168, wherein the shading comprises at least one 
of a grey scale setting and opacity setting. 

196. A system for analyzing an image, comprising; 

display means for displaying an actual image of an object in an image viewer to a user 
for analysis of the image; 

input means for marking a location on the actual image representing image 
coordinates of an image feature; 

viewer status association means for associating a status of the viewer with the feature, 
the status comprising at least one of an orientation, a magnification, and a shading of the 
image; 

location-code list compilation means for compiling a list of user-selectable location- 
codes describing the location of the feature relative to the object; 

description-code compilation means for compiling a list of user-selectable description- 
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codes describing a characteristic of the feature; and 

finding creation means for creating an image finding of the feature, comprising the 
image coordinates of the image feature, the viewer status, at least one location-code selected 
by the user from the location-code list, and at least one description-code selected by the user 
from the description-code list. 

1 97. A system according to claim 1 96, wherein the orientation comprises at least 
one of a translation state and a rotation state. 

198. A system according to claim 196, wherein the magnification comprises a 
degree of image zoom, 

199. A system according to claim 196, wherein the shading comprises at least one 
of a gray scale setting and opacity setting, 

200. A system according to claim 196, wherein the location-code represents an 
anatomical location. 

201 . A system according to claim 1 96, wherein the list of location-codes is 
compiled from a predefined lexicon of location-codes. 

202. A system according to claim 196, wherein at least one of the location-code list 
and the description-code list is at least a subset of a comprehensive list of user selectable 
items. 

203. A system according to claim 196, comprising a content-code retriever for 
retrieving a content-code, denoting what the image data depicts, and for retrieving a reason- 
code, denoting a reason for creating the image data. 

204. A system according to claim 196, wherein the characteristic describes at least 
one physical property of the feature. 
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205. A system according to claim 1 96, wherein the characteristic includes a 
pathology of the feature. 

206. A system according to claim 196, wherein the list of description-codes is 
compiled from a predefined lexicon of description-codes. 

207. A system according to claim 196, comprising a content-code retrieval means 
for retrieving a content-code and associating the content-code with the image, the content- 
code denoting that at least one specific object is depicted within the image, and wherein the 
location-code list is assembled to contain location-codes that are consistent with the content- 
code. 

208. A system according to claim 196, comprising a content-code retrieval means 
for retrieving a content-code and associating the content-code with the image, the content- 
code denoting that at least one specific object is depicted within the image, and wherein the 
description-code list is assembled to contain description-codes that are consistent with the 
content-code. 

209. A system according to claim 196, an annotation association means for 
associating at least one of a dimensional measurement, mean voxel value, standard deviation 
of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered 
image, a video description, and a user-defined illustration with the finding. 

210. A system according to claim 196, comprising a rendering means for rendering 
the image by at least one of volume rendering, surface rendering, and rendering about a point. 

211. A system according to claim 1 96, comprising an image analyzer for 
identif>ing features in the image using computer analysis of the image to provide computer 
identified features. 
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212. A system according to claim 211, wherein the image analyzer is configured to 
correlate the computer identified features with the feature. 

213. A system according to claim 196, comprising a report generator for generating 
a report based on the image finding. 

214. A system according to claim 213, comprising a finding linking means for 
hnking selected findings of a plurality of image findings to create a cumulative finding 
comprising the plurality of image findings. 

215. A system according to claim 213, wherein the report generator is configured to 
assign a priority to at least one of a plurality of image findings and to sort the image findings 
according to priority. 

216. A system according to claim 213, wherein the report generator is configured to 
sort image findings according to at least one of the location-code and the description-code. 

217. A system according to claim 2 1 3, comprising a file loader for retrieving at 
least one prior finding from a previous analysis of an image and for linking the retrieved 
image finding to the image finding of the feature, whereby a set of findings is created 
describing a chronology of the image finding of the feature. 

218. A system according to claim 2 1 3, wherein the report generator is configured to 
compute a selected statistical measure of the report generation process. 

219. A system according to claim 2 1 8, wherein the statistical measure includes at 
least one of total review time, time per findings number of findings, and diagnostic accuracy. 

220. A system according to claim 196, comprising a bill generator for creating a bill 
based on the diagnostic finding. 
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22 1 . A system according to claim 218, wherein the finding creation means is 
configured to associate a recommendation with the image fmding to denote a recommended 
action to be taken with respect to the image finding. 

222. A computer implemented method for analysis of image data comprising the 
steps of: 

displaying an actual image of an object in an image viewer to a user for analysis of the 

image; 

analyzing the image to identify a feature of interest of the object; 

identifying a location of the feature using an input device to selectively mark a 
location on the actual image representing image coordinates of the identified feature; 

associating a status of the viewer with the feature, the status comprising at least one of 
an orientation, a magnification, and a shading of the image; 

associating a position descriptor with the location of the feature, the position 
descriptor representing image coordinates associating a location-code with the feature, the 
location-code selected from a list presented to the user and describing the location of the 
feature relative to the object; 

associating a description-code with the feature to describe a characteristic of the 
feature, the description-code selected from a list presented to the user; and 

creating an image finding of the feature comprising the position descriptor, the 
location-code, the viewer status, and the description-code. 

223. A method according to claim 222 wherein the location-code represents an 
anatomical location. 

224- A method according to claim 222 wherein the list of location-codes is 
compiled from a predefined lexicon of location-codes. 

225. A method according to claim 222 wherein the characteristic describes at least 
one physical property of the feature. 
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226. A method according to claim 222 wherein the list of description-codes is 
compiled from a predefined lexicon of description-codes. 

227. A method according to claim 222 comprising the step of associating a content- 
code with the image, the content-code denoting that at least one specific object is depicted 
within the image, and wherein the description-code list is assembled to contain description- 
codes that are consistent with the content-code. 

228. A method according to claim 224 comprising the step of associating a content- 
code with the image, the content-code denoting that at least one specitic object is depicted 
within the image and wherein the location-code list is assembled to contain location -codes 
that are consistent with the content-code. 

229. A method according to claim 222 wherein the characteristic includes a 
pathology of the feature. 

230. A method according to claim 222 comprising associating at least one of a 
dimensional measurement, mean voxel value, standard deviation of voxel values, an audio 
description, a two-dimensional image, a three-dimensional rendered image, a video 
description, and a user-defmed illustration with the finding. 

23 1 . A method according to claim 222 comprising the step of creating at least one 
thumbnail image of the feature and associating the thumbnail image with the image finding. 

232. A method according to claim 231 comprising the step of displaying the 
thumbnail image wherein selection of the thumbnail image recalls the associated image 
finding. 

233. A method according to claim 222 comprising the step of displaying the image 
includes display in at least one of a two-dimensional viewer and a three-dimensional viewer. 
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234. A method according to claim 233 wherein the image is formed by at least one 
of volume rendering, surface rendering, and rendering about a point. 

235. A method according to claim 233 comprising the step of displaying multiple 
images simultaneously. 

236. A method according to claim 222 wherein the image data includes a digital 

image. 

237. A iHclliou according to claim 222 wherein the image data includes a series of 
trt'o-dimensional images associated with a three-dimensional body. 

238. A method according to claim 222 comprising the step of identifying features in 
the image using computer analysis of the image to provide computer identified features. 

239. A method according to claim 238 comprising the step of correlating the 
computer identified features with the feature. 

240. A method according to claim 222 comprising the step of recording a cine clip 
showing a time varying characteristic of the feature. 

241. A method according to claim 222 comprising creating a plurality of image 
findings. 

242. A method according to claim 241 comprising the step of generating a report 
based on the image findings. 

243. A method according to claim 242 wherein the step of generating the report 
comprises incorporating a cumulative finding by linking selected findings of the plurality of 
image findings to create the cumulative finding encompassing the pIuraHty of image findings. 
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244. A method according to claim 242 wherein the step of generating the report 
comprises incorporating a primary finding by linking related findings to associate the related 
findings to create the primary finding. 

245. A method according to claim 242 wherein the step of generating the report 
comprises the step of assigning a priority to at least one of the image findings and sorting 
image findings according to priority. 

246. A method according to claim 242 wherein the step of generating the report 
compnses the step of sorting image tmdings according to at least one of the location-code and 
the description-code. 

247. A method according to claim 242 wherein the step of generating the report 
comprises incorporating a chronology of an image finding by 

retrieving at least one previous finding associated with the feature from a previous 
analysis and 

linking the retrieved image finding to the image finding of the feature whereby the 
chronology of the image finding of the feature is created. 

248. A computer implemented method for analysis of an image, substantially as 
hereinbefore described with reference to the accompanying figures. 

249. A system for the analysis of image data, substantially as hereinbefore 
described with reference to the accompanying figures. 

250. A system for analyzing an image, substantially as hereinbefore described with 
reference to the accompanying figures. 
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251. A computer implemented method for analysis of image data, substantially 
herein described with reference to the accompanying figures. 

DATED this 29* day of July, 2004 

WAKE FOREST UNIVERSITY 
By Their Patent Attorneys 
DAVmS COLLISON CAVE 
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